Display system, display apparatus and method for controlling the same

ABSTRACT

A display system is provided. The display system includes a display apparatus configured to display an image; an image providing apparatus configured to provide an image in response to receiving a control signal for controlling the image providing apparatus; and a remote control configured to transmit the control signal for controlling the image providing apparatus, wherein the display apparatus is further configured to receive the control signal transmitted by the remote control and the image provided by the image providing apparatus, and analyze the control signal and the image to obtain apparatus information of the image providing apparatus.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority from Korean Patent Application No.10-2016-0001121, filed on Jan. 5, 2016 in the Korean IntellectualProperty Office, the disclosure of which is incorporated herein byreference in its entirety.

BACKGROUND

1. Field

Apparatuses and methods consistent with exemplary embodiments relate tocontrolling the same, and more particularly, to a display apparatuscapable of obtaining apparatus information on an external apparatus, amethod for controlling the same, and a display system including thedisplay apparatus.

2. Description of the Related Art

With the advancement of digital display technology, it has becomepossible to connect various external electronic devices that providevideo content, such as a set-top box, a digital versatile disc (DVD)player, an audio, and the like, to a display apparatus such as atelevision.

Accordingly, multiple external electronic devices that serve as imagesources may be connected to the display apparatus, and a user may switchamong the numerous connected devices.

However, a related art display apparatus may not be able to recognizethe exact type or manufacturer of the image source and may simplyindicate the source names corresponding to the external electronicdevices by the input ports through which the image sources areconnected, such as High-Definition Multimedia Interface (HDMI) 1, HDMI2, video graphics array (VGA), composite, etc. Thus, the user may havedifficulty identifying which electronic device corresponds which port.For example, if the user wants to select the set-top box, the user needsto know whether the set-top box is connected to HDMI 1 or HDMI 2.

Accordingly, there exists a need to provide to the user morecomprehensive and intuitive information about the external electronicdevices connected to the display apparatus.

SUMMARY

Exemplary embodiments of the present disclosure overcome the abovedisadvantages and other disadvantages not described above. Also, thepresent disclosure is not required to overcome the disadvantagesdescribed above, and an exemplary embodiment of the present disclosuremay not overcome any of the problems described above.

Exemplary embodiments provide a display apparatus capable of obtainingapparatus information on an external apparatus, a method for controllingthe same, and a display system including the display apparatus.

According to an aspect of an exemplary embodiment, a display systemincludes a display apparatus configured to display an image; an imageproviding apparatus configured to provide an image in response toreceiving a control signal for controlling the image providingapparatus; and a remote control configured to transmit the controlsignal for controlling the image providing apparatus, wherein thedisplay apparatus is further configured to receive the control signaltransmitted by the remote control and the image provided by the imageproviding apparatus, and analyze the control signal and the image toobtain apparatus information of the image providing apparatus.

According an aspect of another exemplary embodiment, a display apparatusincludes a communicator configured to receive, from a remote control, acontrol signal for controlling an image providing apparatus, and receivean image provided by the image providing apparatus in response to theimage providing apparatus receiving the control signal; a displayconfigured to display the received image; and a processor configured toobtain apparatus information of the image providing apparatus based onthe control signal and the image.

According to an aspect of another exemplary embodiment, a method forcontrolling a display apparatus includes receiving, by the displayapparatus, a control signal for controlling an image providing apparatustransmitted by a remote control; and obtaining apparatus information ofthe image providing apparatus based on the control signal and an imagethat is provided by the image providing apparatus in response to theimage providing apparatus receiving the control signal transmitted bythe remote control.

According to an aspect of another exemplary embodiment, acomputer-readable recording medium including a program for performingthe method for controlling a display apparatus is provided.

According to an aspect of another exemplary embodiment, there isprovided a non-transitory computer-readable storage medium storinginstructions which, when executed by a processor, cause the processor toperform operations comprising: receiving, at a first time by a displaydevice, a first image from an image output device connected to thedisplay device, receiving, at a second time after the first time and bythe display device, a control signal for controlling the image outputdevice, receiving, at a third time after the second time and by thedisplay device, a second image from the image output device, comparing,by the display device, the first image and the second image to identifya difference between the first image and the second image, anddetermining, by the display device, a device type of the image outputdevice based on the control signal and the difference between the firstimage and the second image.

The image output device may be one of a digital versatile disc (DVD)player, a Blu-disc player, a digital video recorder (DVR), a set-topbox, a home theater system, and an over-the-top (OTT) device.

The difference between the first image and the second image may comprisea change in at least one of a volume, a channel, a broadcast network, animage source, a user interface element.

BRIEF DESCRIPTION OF THE DRAWING FIGURES

The above and/or other aspects will be more apparent by describingcertain exemplary embodiments with reference to the accompanyingdrawings, in which:

FIG. 1 is a diagram illustrating a display system according to anexemplary embodiment;

FIG. 2 is a block diagram illustrating a configuration of a displayapparatus according to an exemplary embodiment;

FIG. 3 is a diagram illustrating a method for obtaining apparatusinformation of an image providing apparatus by the display apparatusaccording to an exemplary embodiment;

FIG. 4 is a diagram illustrating an image change sensing of the displayapparatus according to an exemplary embodiment;

FIGS. 5 and 6 are diagrams illustrating a method for analyzing an imageof the display apparatus according to various exemplary embodiments;

FIG. 7 is a diagram illustrating one example a graphical user interface(UI) screen provided from the display apparatus;

FIG. 8 is a diagram illustrating a source list providing of the displayapparatus according to an exemplary embodiment;

FIG. 9 is a flowchart illustrating a method for controlling a displayapparatus according to an exemplary embodiment; and

FIG. 10 is a block diagram illustrating a detailed configuration of thedisplay apparatus according to an exemplary embodiment.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

Before specifically describing the present disclosure, a method fordemonstrating the present specification and drawings will be described.

First, as terms used in the present specification and claims, generalterms have been selected by considering functions in diverse exemplaryembodiments of the present disclosure. However, such terms may be varieddepending on an intention of those skilled in the art, a regal ortechnical interpretation, an emergence of a new technology, and thelike. Further, some terms may be terms which are arbitrarily selected byan applicant. Such terms may be interpreted as meanings defined in thepresent specification, and may also be interpreted based on generalcontents of the present specification and a typical technical concept inthe art unless the terms are not specifically defined.

Further, the same reference numerals or symbols described in theaccompanying drawings of the present specification denote parts orcomponents that perform substantially the same function. For convenienceof explanation and understanding, the description will be provided usingthe same reference numerals or symbols in different exemplaryembodiments. That is, although a plurality of drawings illustrate all ofthe components having the same reference numeral, the plurality ofdrawings do not mean one exemplary embodiment.

In addition, in order to distinguish between the components, termsincluding an ordinal number such as “first,” “second,” etc. may be usedin the present specification and claims. The ordinal number is used todistinguish the same or similar components from each other, and themeaning of the terms should not be interpreted as being limited due tothe usage of the above-mentioned ordinal number. As an example, thecomponents coupled to the ordinal number should not be interpreted as ause order, a layout order, or the like being limited by the number. Therespective ordinal numbers are interchangeably used, if necessary.

In the present specification, the singular expression includes theplural expression unless the context clearly indicates otherwise. In thepresent application, the terms “include” and “consist of” designate thepresence of features, numbers, steps, operations, components, elements,or a combination thereof that are written in the specification, but donot exclude the presence or possibility of addition of one or more otherfeatures, numbers, steps, operations, components, elements, or acombination thereof.

A term “module,” “unit,” “part,” or the like, in the exemplaryembodiment is a term for referring to the component performing at leastone function or operation, and such component may be implemented inhardware or software or a combination of hardware and software. Inaddition, a plurality of “modules,” “units,” “parts,” or the like may beintegrated into at least one module or chip and may be implemented in atleast one processor, except for a case in which they need to be eachimplemented in individual specific hardware.

In addition, in the exemplary embodiment, it will be understood thatwhen an element is referred to as being “connected to” another element,it can be directly “connected to” the other element or other elementsintervening therebetween may be present. In addition, unless explicitlydescribed otherwise, “comprising” any components will be understood toimply the inclusion of other components but not the exclusion of anyother components.

Hereinafter, the present disclosure will be described in detail withreference to the accompanying drawings.

FIG. 1 is a diagram illustrating a display system according to anexemplary embodiment.

As shown in FIG. 1, the display system 1000 includes a display apparatus100, an image providing apparatus 200, and a remote control 300.

The display apparatus 100 may be a television (TV) as illustrated inFIG. 1, but that is merely one example. The display apparatus 100 may beimplemented as various apparatuses such as a smart phone, a tabletpersonal computer (PC), a desktop PC, a projector, and the like.

The image providing apparatus 200 may provide an image to the displayapparatus 100. As illustrated in FIG. 1, the image providing apparatus200 may be wired-connected to the display apparatus 100. For example,the image providing apparatus 200 may provide the image through anHigh-Definition Multimedia Interface (HDMI) port of the displayapparatus 100. However, the image providing apparatus 200 is not limitedthereto, but may also be implemented to provide the image the displayapparatus 100 by performing wireless communication.

The image providing apparatus 200 may be implemented as various kinds ofapparatuses such as a digital versatile disc (DVD) player, a Blue-raydisc player, a PC, a Universal Serial Bus (USB) device, a video gameconsole, a home theater system, an audio player, a set-top box, anover-the-air (OTA) antenna, an over-the-top (OTT) device, and the like.

The remote control 300 may be implemented as various kinds ofapparatuses that may transmit control signals for controlling otherapparatuses. For example, the remote control 300 may be a dedicatedremote control that is able to only control a specific apparatus, or bea multi-brand remote (MBR) which is able to control several apparatuses(otherwise known as a universal remote control), and may be a portabledevice such as a smartphone, a personal digital assistant (PDA), or thelike.

The remote control 300 may include a direction key button, a number keybutton, a menu button, a touch pad, and the like. The remote control 300may generate various control signals corresponding to the direction keybutton, the touch pad, and other buttons.

The display apparatus 100 may perform an analysis for the image providedfrom the image providing apparatus 200 in order to obtain apparatusinformation of the image providing apparatus 200, and may performvarious operations using the obtained apparatus information. As anexample, the display apparatus 100 may perform a multi-brand remotesetting for the remote control 300 so that the remote control 300 maycontrol the image providing apparatus 200 using the obtained apparatusinformation of the image providing apparatus 200.

As another example, the display apparatus 100 may update an apparatusname of the image providing apparatus 200 in the display apparatus 100based on the obtained apparatus information of the image providingapparatus 200.

Hereinafter, the display apparatus 100 in the display system 1000described above will be described in more detail.

FIG. 2 is a diagram illustrating the display apparatus 100 according toan exemplary embodiment.

As shown in FIG. 2, the display apparatus 100 may include a communicator110, a display 120, and a processor 130.

The communicator 110 is a component for performing wireless or wiredcommunication with a variety of external devices. Specifically, thecommunicator 110 may include input/output ports for a wired connectionwith the external device, and various communication chips such as aWi-Fi chip, a Bluetooth chip, an near-field communication (NFC) chip, awireless communication chip, and the like for performing wirelesscommunication.

The communicator 110 may communicate with the image providing apparatus200 to receive the image from the image providing apparatus 200. Inaddition, the communicator 110 may transmit a control command allowingthe remote control 300 to transmit a specific control signal to theremote control 300. According to an aspect of an exemplary embodiment,the communicator 110 may receive the control signal transmitted from theremote control 330 to control the image providing apparatus 200.

The display 120 is a component for displaying various screens accordingto a control of the processor 130.

The display 120 may be, for example, implemented as a liquid crystaldisplay (LCD), a cathode-ray tube (CRT), a plasma display panel (PDP),an organic light emitting diode (OLED) display, a transparent OLED(TOLED) display, or the like. In addition, the display 120 may also beimplemented in a form of a touch screen capable of sensing a touchmanipulation of a user.

The display 120 may display the image provided from the image providingapparatus 200. In addition, the display 120 may display various userinterface (UI) screens which are prestored.

The processor 130 is a component for controlling an overall operation ofthe display apparatus 100.

For example, the processor 130 may include a central processing unit(CPU), a random access memory (RAM), a read-only memory (ROM), and asystem bus. Here, the ROM is a component in which an instruction set forbooting a system is stored, and the CPU copies an operating system (OS)stored in a storage of the display apparatus 100 to the RAM according toan instruction stored in the ROM, and executes the operating system (OS)to thereby boot the system. When the booting is completed, the CPUcopies a variety of applications stored in the storage to the RAM, andexecutes the applications, thereby making it possible to perform avariety of operations. Hereinabove, although the case in which processor130 includes only one CPU is described, the processor 130 may beimplemented by a plurality of CPUs (or digital signal processor (DSP),system on chip (SoC), etc.) at the time of being implemented.

In particular, the processor 130 may acquire the apparatus informationof the image providing apparatus 200 in cooperation with the remotecontrol 300. Specifically, in the case in which the remote control 300is a dedicated remote control (hereinafter, referred to as a firstremote control 300′) of the image providing apparatus 200, the apparatusinformation may be obtained according to exemplary embodiments to bedescribed below.

FIG. 3 is a diagram illustrating a method for obtaining apparatusinformation of an image providing apparatus 200 by the display apparatus100 according to an exemplary embodiment. Here, the display apparatus100 may include an optical receiver 140 in addition to the communicator110, the display 120, and the processor 130. The optical receiver 140may receive an optical control signal which is output and transmittedfrom an optical output unit 320 of the first remote control 300′ throughan optical window.

The first remote control 300′ may transmit the optical control signalthrough the optical output unit 320. In this case, the optical outputunit 320 may include an infrared-light emitting diode (IR-LED), and maygenerate an IR control signal according to a control of a processor ofthe first remote control 300′.

First, when the user presses down any key of the first remote control300′ to transmit a control signal for controlling the image providingapparatus 200 ({circle around (1)}), the display apparatus 100 mayreceive the control signal through an optical receiving unit 140({circle around (2)}). This is referred to as IR sniffing.

In addition, the image providing apparatus 200 may receive the controlsignal, and transmit the image to the display apparatus 100 according tothe received control signal ({circle around (3)}).

The display apparatus may also receive the control signal, and if animage change is sensed with respect to the image provided from the imageproviding apparatus 200, the received control signal and a current imagemay be analyzed ({circle around (4)}).

Specifically, the processor 130 may identify the received control signalbased on a waveform of the control signal. In addition, the processor130 may detect a control command corresponding to the control signalthrough the image analysis in which images before and after thereception of the control signal are compared. This will be described inmore detail with reference to FIG. 4.

FIG. 4 is a diagram illustrating an example in which the displayapparatus 100 determines the control command corresponding to thereceived control signal based on the image change.

As shown in FIG. 4, a first image 410 is an image before the displayapparatus 100 receives the control signal for controlling the imageproviding apparatus 200 from the first remote control 300′, and a secondimage 420 is an image after the display apparatus 100 receives thecontrol signal.

The processor 130 of the display apparatus 100 may compare the firstimage 410 with the second image 420 and determine that the controlcommand corresponding to the control signal is the control command forperforming a channel-up. Specifically, the processor 130 may extract achannel number region 41 of the first image 410, extract a channelnumber region 42 of the second image 420, and recognize channel numbersof the extracted regions through optical character recognition (OCR), tothereby determine that the channel number has changed from the number of7 to the number of 8 and determine that the control command correspondsto performing the channel-up.

According to an aspect of an exemplary embodiment, the processor 130 mayextract characteristics information of the first image 410 and thesecond image 420, and transmit the extracted characteristics informationto an external server capable of recognizing the image based on thecharacteristics information of the image. In addition, the processor 130may receive channel information corresponding to the first image 410 andchannel information corresponding to the second image 420 to therebydetermine that the channel-up is performed. Here, the characteristicsinformation transmitted to the external server may be a water mark or adigital fingerprint, which is identity information of the image.

According to an aspect of an exemplary embodiment, the processor 130 maycompare the images before receiving the control signal and afterreceiving the control signal, and may determine that the control commandcorresponding to the control signal is a command for volume control whenit is recognized that a graphical object or a volume control on-screendisplay (OSD) element indicating that a volume is changed appears in theimage after receiving the control signal.

Using various known image analysis technologies in addition to themethods described above, the processor 130 may determine which controlcommand corresponds to the received control signal.

In addition, the processor 130 may obtain the apparatus information ofthe image providing apparatus 200 based on the determined controlcommand and the received control signal. Specifically, the displayapparatus 100 may store a plurality of control code sets correspondingto the image providing apparatuses of known manufacturers, and theprocessor 130 may detect a matching control code set for the receivedcontrol signal and the determined control command among the plurality ofpreloaded control code sets to thereby obtain the apparatus informationof the image providing apparatus 200. Meanwhile, although the controlcode sets of the respective manufacturers may be preloaded in thedisplay apparatus 100 is described, the display apparatus 100 may alsoreceive the control code sets of the respective manufacturers from anexternal server, if needed.

Meanwhile, even for devices designed by different manufacturers, thecontrol signals corresponding to a specific control command may beidentical to each other. For example, if a control signal for achannel-up operation in a control code set of manufacturer A and acontrol signal for a channel-up operation in a control code set ofmanufacturer B are identical to each other, it may be difficult for thedisplay apparatus 100 to correctly identify the manufacturer of theimage providing apparatus 200 by information obtained through thecontrol signal analysis and the image change analysis alone.

Therefore, according to an aspect of an exemplary embodiment, if theimage provided from the image providing apparatus 200 includes contentcapable of specifying the image providing apparatus 200, the apparatusinformation of the image providing apparatus 200 may be obtained throughthe image analysis.

For example, the processor 130 may sense a manufacturer's logo of theimage providing apparatus 200 from the image provided by the imageproviding apparatus 200, and may obtain the apparatus information of theimage providing apparatus 200 based on the sensed manufacturer logo.However, the method based on the logo recognition is merely one example,and any image may be used as long as the image includes the contentsfrom which the apparatus information of the image providing apparatus200 may be recognized through the image analysis.

As one example, obtaining the apparatus information through the logowill be described below in more detail with reference to FIG. 5.

FIG. 5 illustrates one example of the image provided by the imageproviding apparatus 200.

As shown in FIG. 5, an image 510 of the image providing apparatus 200provided to the display apparatus 100 according to the control signaltransmitted from the first remote control 300′ may include a logo 51.The processor 130 may sense whether the logo 51 corresponds to anymanufacturer's logo, based on the known logos of manufacturers which maybe preloaded in the display apparatus 100. Therefore, the processor 130may obtain the apparatus information of the image providing apparatus200.

As another example, the processor 130 may sense the channel number andthe broadcast logo within the image provided by the image providingapparatus 200 to thereby obtain the apparatus information of the imageproviding apparatus 200.

Specifically, if the image providing apparatus 200 is a set-top box,even though the channel number is identical for each of the manufacturerof the set-top box, images of different broadcasting stations areprovided. For example, it is assumed that a channel 1 in the set-top boxof a company A corresponds to CBS, and a channel 1 in the set-top box ofa company B corresponds to NBC. The processor 130 may analyze the imageprovided from the image providing apparatus 200 to determine that theimage providing apparatus 200 is the set-top box of the company A whenthe channel number is 1 and the sensed broadcast logo is CBS, and todetermine that the image providing apparatus 200 is the set-top box ofthe company B when the channel number is 1 and the sensed broadcast logois NBC. This will be described in more detail with reference to FIG. 6.In addition, a database of various UI elements, fonts, images, etc. thatare tied to known manufacturers may be used to identify the specificmanufacturer of the image providing apparatus 200. Moreover, a placementof these elements within the screen may also provide clues fordetermining the manufacturer.

FIG. 6 illustrates one example of a specific channel image provided fromthe image providing apparatus 200.

As shown in FIG. 6, a specific channel image 610 of the image providingapparatus 200 provided to the display apparatus 100 includes a channelnumber 61 and a channel logo 63. The processor 130 may sense whether thelogo 63 corresponds to any specific broadcast network's logo, based onthe logos of the manufacturers and broadcast networks which arepreloaded in the display apparatus 100. In addition, the processor 130may recognize the number of the channel number 61 through a characterrecognition method such as optical character recognition (OCR), or thelike. Therefore, the processor 130 may detect that a manufacturer of theimage providing apparatus 200 is a manufacturer that associates thechannel number 61 to the logo 63. As a result, the processor 130 mayobtain the apparatus information of the image providing apparatus 200.

That is, as such, after the processor 130 receives the control signalfor controlling the image providing apparatus 200 from the first remotecontrol 300′, when the image is provided from the image providingapparatus 200 and a change is sensed in a current image, the processormay obtain the apparatus information of the image providing apparatus200 by analyzing the changed image.

Meanwhile, if the image analysis technology as described above returnsmore than one matching results, recognition accuracy of the logo or thechannel number may decrease, and it may be difficult to pinpoint any onemanufacturer.

Therefore, in this case, if the method for analyzing the control signaland the image change, and the method for analyzing the contentsindicating the manufacturer within the image are simultaneously used,the apparatus information of the image providing apparatus 200 may bemore accurately obtained. That is, the processor 130 may receive thecontrol signal transmitted from the first remote control 300′, determinethe control command corresponding to the control signal through theimage changed to correspond to the control signal, and sense a specificobject such as the logo or the channel number within the image providedfrom the image providing apparatus 200, to thereby finally obtain theapparatus information of the image providing apparatus 200.

As such, the display apparatus 100 may autonomously obtain the apparatusinformation of the image providing apparatus 200. Alternatively, thedisplay apparatus 100 may obtain the apparatus information of the imageproviding apparatus 200 by means of the server. Specifically, theprocessor 130 of the display apparatus 100 may transmit the determinedcontrol command and control signal to the server to thereby control thecommunicator 110 to receive the apparatus information of the imageproviding apparatus 200 from the server. In addition, the displayapparatus 100 may receive data required to analyze the image, forexample, information on the logo of the manufacturer, or the like, fromthe server.

Meanwhile, the data for obtaining the apparatus information of the imageproviding apparatus 200 through the image analysis, for example, thelogo for each of the manufacturers, or the like, may be stored in thedisplay apparatus 100, or may be stored in the external server. In thecase in which the data is stored in the external server, the displayapparatus 100 may transmit the image provided from the image providingapparatus 200 to the external server to thereby obtain the apparatusinformation of the image providing apparatus 200 from the externalserver, or receive the data from the external server, if needed.Meanwhile, if the display apparatus 100 fails to obtain the apparatusinformation, the display apparatus 100 may transmit the failure resultto the external server to thereby receive additional data from theexternal server and update the data of the display apparatus 100, andthe external server may perform a supplementary task so that an accurateimage recognition may be performed, based on the failure result.

Meanwhile, the processing for obtaining the apparatus information of theimage providing apparatus 200 as described above may be initiated oncondition that the image providing apparatus 200 is newly discovered andthe control signal for controlling the image providing apparatus 200 isreceived. Therefore, because the processing for obtaining the apparatusinformation is performed only when the control signal is received, awaste of a memory may be reduced. Meanwhile, newly discovering the imageproviding apparatus 200 may mean that a new image providing apparatus200 is sensed by the display apparatus 100, and may specifically meanthat the new image providing apparatus 200 is connected to an input portof the display apparatus 100.

As described above, if the display apparatus 100 obtains the apparatusinformation of the image providing apparatus 200 in cooperation with thefirst remote control 300′, it is possible to control the image providingapparatus 200 using another remote control (hereinafter, referred to asa second remote control) instead of the dedicated remote control of theimage providing apparatus 200.

Specifically, the display apparatus 100 may control the communicator 110so as to transmit the control code set corresponding to the obtainedapparatus information to the second remote control. In this example, thesecond remote control is an apparatus that may perform wirelesscommunication such as Bluetooth, and the display apparatus 100 maytransmit the control code set via a wireless communication scheme suchas Bluetooth through the communicator 110. In addition, the secondremote control may control the image providing apparatus 200 using thereceived control code set.

According to an aspect of an exemplary embodiment, the display apparatus100 may store information regarding a correspondence relationshipbetween a button of the first remote control and the control code forcontrolling the image providing apparatus 200. Therefore, a firstcontrol signal generated from the second remote control may be convertedinto a second control signal that is suitable for the control of theimage providing apparatus 200. Specifically, if the user selects aspecific button in the second remote control, the second remote controltransmits the first control signal corresponding to the selected button.The display apparatus 100 receives the first control signal, andtransmits a command transmitting the first received control signal andthe second control signal corresponding to the apparatus information ofthe image providing apparatus 200 to the second remote control. Inaddition, the second remote control may control the image providingapparatus 200 by transmitting the second control signal according to thecommand received from the display apparatus 100.

In this scheme, the second remote control may be operated as amulti-brand remote (i.e., universal remote control) capable ofcontrolling various image providing apparatuses. In particular, if thesecond remote control is a remote control capable of controlling thedisplay apparatus 100, it may be more convenient for the user becausethe user may control the image providing apparatus 200 as well as thedisplay apparatus 100 using only the second remote control instead ofhaving to use multiple remote controls.

Meanwhile, when the apparatus information of the image providingapparatus 200 is obtained, the display apparatus 100 may display a UIscreen informing the user that the second remote control may be usedinstead of the first remote control 300′. This will be described belowwith reference to FIG. 7.

FIG. 7 illustrates one example of the UI screen displayed by the displayapparatus 100 according to an exemplary embodiment.

A shown in FIG. 7, when the apparatus information of the image providingapparatus 200 is obtained, the display apparatus 100 may display anotification UI 715 informing that the image providing apparatus 200 maybe controlled by the remote control of the display apparatus 100 (i.e.,the second remote control). For example, as illustrated in FIG. 7, thenotification UI 715 may be displayed on top of an image 710 providedfrom the image providing apparatus 200, which is a current imageproviding source. Such notification UI 715 may be removed by selecting aconfirmation button 71.

Alternatively, the notification UI 715 may also be provided to have arelatively small size within the screen so as not to disturb a viewingof the current image 710, and may be set so that the notification UI 715automatically disappears after a predetermined time lapses.

According to an aspect of an exemplary embodiment, the display apparatus100 may transmit the control command for generating the screen such asthe notification UI 715 to the second remote control via the wirelesscommunication scheme such as Bluetooth. Accordingly, the screen such asthe notification UI 715 may be displayed on a display included in thesecond remote control. Therefore, the user may be provided with thenotification UI 715 from the second remote control without covering thescreen of the display apparatus 100.

Alternatively, the display apparatus 100 may transmit a control commandoutputting a voice informing that the second remote control may controlthe image providing apparatus 200 to the second remote control.Accordingly, such information may also be output as the voice through aspeaker included in the second remote control.

According to the exemplary embodiment described above, because the userdoes not need to manually input the apparatus information of the imageproviding apparatus 200 to the display apparatus 100 as in the relatedart in order to use the second remote control as the multi-brand remote,and it is possible to appropriately inform the user that the secondremote control may be used as the multi-brand remote, utilization of thesecond remote control as the multi-brand remote may be increased.

Meanwhile, the apparatus information of the image providing apparatus200 obtained by the display apparatus 100 may be used for a multi-brandremote setting of the second remote control, and may also be utilizedfor a source name update of the image providing apparatus 200 in thedisplay apparatus 100. This will be described with reference to FIG. 8.

FIG. 8 is a diagram illustrating one example of utilization of theobtained apparatus information of the image providing apparatus 200.

FIG. 8, which illustrates source lists provided by the display apparatus100, is a diagram comparing a source list 810 before the apparatusinformation of the image providing apparatus 200 is obtained and asource list 820 after the apparatus information thereof is obtained.Meanwhile, such source lists may be displayed on the display 120according to the user command through the remote control 300.

Specifically, if the processor 130 obtains the apparatus information ofthe image providing apparatus 200 as in the exemplary embodimentsdescribed above, the processor 130 may update a source namecorresponding to the image providing apparatus 200 using the obtainedapparatus information of the image providing apparatus 200.

As shown in FIG. 8, before the apparatus information is obtained, asource list 810 may include port names (HDMI1, HDMI 2, AV1, etc.) of thesources before the update may be provided from the display apparatus100. After the apparatus information is obtained, the source name mayget updated such that a list including manufacturer information (e.g.,Samsung, Chromecast, etc.) such as the updated source list 820 may beprovided. The manufacturer information may also include identities ofcontent providers such as broadcast networks, video-on-demand (VOD)providers, online streaming services, etc.

In addition, the manufacturer information as well as information on akind of device may also be provided to the updated source list 820. Forexample, the update source list 820 may include the manufacturerinformation and the device type if the image providing apparatus 200 isa set-top box, and may include the device type if the image providingapparatus 200 is Blue-ray player, a digital video recorder (DVR), a hometheater system (HTS) apparatus, and may include manufacturer informationand a device name in the case in which the image providing apparatus isan over-the-top (OTT) and a game device. The information on the kind ofdevice may be obtained by different schemes depending on the device. Forexample, the information on the kind of device may be obtained bydirectly inputting, by the user, the information on the kind of deviceto the display apparatus 100, or may be obtained by only a connectionwith the display apparatus 100.

Meanwhile, the apparatus information of the image providing apparatus200 may be used for the source name update as described above, and maybe transmitted to the external server to be collected. Accordingly, theexternal server may provide a service suitable for the business operatorof the image providing apparatus 200 through the display apparatus 100.For example, the external server may provide an EPG corresponding to thebusiness operator of the image providing apparatus 200 to the displayapparatus 100. As well, the apparatus information of the image providingapparatus 200 may also be used for a statistic purpose.

FIG. 9 is a diagram illustrating a method for controlling a displayapparatus 100 according to an exemplary embodiment.

In FIG. 9, the display apparatus 100 may receive a control signal forcontrolling an operation of the image providing apparatus 200 (S910).Such control signal may be an IR signal transmitted from the firstremote control 300′ capable of controlling the image providing apparatus200. The display apparatus 100 may receive the IR signal generated tocontrol the image providing apparatus 200 by performing IR sniffing forthe IR signal.

In addition, the display apparatus 100 may obtain the apparatusinformation of the image providing apparatus 200, based on an imageprovided from the image providing apparatus 200 after receiving thecontrol signal, and the received control signal (S920).

According to an aspect of an exemplary embodiment, the display apparatus100 may compare the image provided from the image providing apparatus200 before the first remote control 300′ transmits the control signal,and the image provided from the image providing apparatus 200 after thefirst remote control 300′ transmits the control signal, to thereby sensean image change type, and may obtain the apparatus information of theimage providing apparatus 200, based on the sensed image change type andthe control signal received by the display apparatus 100 from the firstremote control 300′.

However, if multiple apparatus candidates are obtained based on theimage change type and the control signal, the display apparatus 100 maynarrow the choices down to one apparatus based on the contents fromwhich a manufacture of the image providing apparatus 200 may berecognized (e.g., the logo (see FIG. 5) of the image providing apparatus200, a matching relationship (see FIG. 6) between the channel number andthe broadcast logo, and the like), in the image provided from the imageproviding apparatus 200.

According to an aspect of an exemplary embodiment, the display apparatus100 may detect contents from which the manufacturer of the imageproviding apparatus 200 may be detected in the image provided from theimage providing apparatus 200, and may select one apparatus frommultiple apparatus candidates based on the image change type and thecontrol signal as additionally described in the case in which multipleapparatus candidates are obtained based on the detected contents.

That is, as a method for obtaining, by the display apparatus 100, theapparatus information of the image providing apparatus 200 using thefirst remote control 300′, (1) a method based on the control signal forwhich the IR sniffing is performed and the image change is sensed, (2) amethod for sensing manufacturer-specific content in the image providedfrom the image providing apparatus 200, or (3) a method forsimultaneously performing the method (1) and the method (2) may be used.

Meanwhile, in the methods (1) and (3), because an information obtainingprocess may be initiated only if the display apparatus 100 performssniffing for the IR signal, there is an advantage that memory waste maybe reduced.

FIG. 10 is a block diagram illustrating a detailed configuration of thedisplay apparatus 100 according to an aspect of an exemplary embodiment.The display apparatus 100 may further include components such as anoptical receiver 140, a storage 150, an audio processor 160, a videoprocessor 170, and an audio output interface 180, in addition to thecommunicator 110, the display 120, and the processor 130.

Overlapping descriptions of the same operations as those described aboveof the operations of the communicator 110, the display 120, and theprocessor 130 will be omitted.

The communicator 110 may include an antenna input port 111, HDMI inputports 1 to n (112-1 to 112-n), a USB port 113, a component input jack114, a PC input jack 115, a button 116, a Bluetooth chip 117, an opticalreceiver 140, and the like.

The optical receiver 140 may receive an optical signal such as an IRsignal through an optical window. The IR signal received through theoptical receiver 140 may be a signal for controlling the displayapparatus 100, or may be a signal received by performing IR sniffing fora signal for controlling other apparatuses.

The processor 130 may analyze a waveform of the IR signal received withIR sniffing to thereby identify the IR signal. In addition, theprocessor 130 may analyze the image received through the communicator110 to thereby sense a change in the image corresponding to the IRsignal, and may detect the sensed image change type to thereby determinethe control command corresponding to the IR signal. In addition, theprocessor 130 may obtain the apparatus information corresponding to thedetermined control command and the IR signal as the apparatusinformation of the image providing apparatus 200.

The communicator 110 may include a communication chip such as theBluetooth chip 117. In addition, the communicator 120 may includevarious communication chips such as a Wi-Fi chip, an NFC chip, awireless communication chip, and the like. If the Bluetooth chip 117 isused, the communicator 110 may first transmit and receive a variety ofaccess information such as a service set identifier (SSID), a sessionkey, and the like; perform a communication connection using the varietyof access information; and then transmit and receive a variety ofinformation.

The display apparatus 100 may include a tuner for selecting a broadcastchannel received through the antenna input port 111.

The processor 130 may transmit a variety of control commands to theremote control 300 through the communicator 110 in the Bluetoothcommunication scheme. In particular, the processor 130 may transmit thecontrol command including the IR code set to the remote control 300 inthe Bluetooth scheme.

The button 116 may be, for example, a power button, a mute button, avolume change button, or a channel change button.

The audio processor 160 may be a component performing processing foraudio data. The audio processor 160 may perform various processing taskssuch as decoding, amplification, noise filtration, and the like for theaudio data.

The video processor 170 may be a component performing processing for theimage data received by the communicator 110. The video processor 170 mayperform various image processing tasks such as decoding, scaling, noisefiltering, frame rate conversion, resolution conversion, and the likefor the image data.

The audio output interface 180 may include a speaker 181, a headphonesoutput terminal 182 and/or an Sony/Philips Digital Interface Format(S/PDIF) output terminal 183 for outputting the audio data processed bythe audio processor 160.

The storage 150 may store various data, programs or applications fordriving and controlling the display apparatus 100 by the control of theprocessor 130.

The storage 150 may be a non-volatile memory, a volatile memory, a harddisk drive (HDD), or a solid-state drive (SSD). In addition, the storage150 may be a memory card (e.g., a micro Secure Digital (SD) card, a USBmemory) mounted in the display apparatus 100.

The storage 150 may store various modules such as an image processingmodule, an image recognition module, an IR sniffing module, and thelike. In addition, the storage 150 may store a broadcast receivingmodule, a channel control module, a volume control module, acommunication control module, a voice recognition module, a motionrecognition module, an optical receiving module, a display controlmodule, an audio control module, an external input control module,and/or a power control module. In addition, the storage 150 may store IRcode sets for various manufacturers of the image providing apparatus,manufacturer logos, broadcast network logos, and the like.

The processor 130 may control an overall operation of the displayapparatus 100 using a variety of programs stored in the storage 150.

The controller 130 may include a random access memory (RAM) 131, aread-only memory (ROM) 132, a graphics processing unit 133, a centralprocessing unit (CPU) 134, first to n-th interfaces 135-1 to 135-n, anda bus 136. Here, the RAM 131, the ROM 132, the graphics processing unit133, the CPU 134, the first to n-th interfaces 135-1 to 135-n, and thelike may be connected to each other through the bus 136.

The ROM 132 may store a set of instructions for booting a system, andthe like. When a turn-on instruction is input to supply power to the CPU134, the CPU 134 may copy an operating system (OS) stored in the storage150 to the RAM 131 according to the instructions stored in the ROM 132,and execute the OS to boot the system. When the booting of the system iscompleted, the CPU 134 may copy a variety of application programs storedin the storage 150 to the RAM 131, and execute the application programscopied to the RAM 131 to perform a variety of operations.

The graphics processing unit 133 may generate a screen including variousobjects such as an icon, an image, a text, and the like using acalculator and a renderer. The calculator calculates attribute valuessuch as coordinate values, shapes, sizes, colors, and the like in whichthe respective objects are to be displayed according to a layout of thescreen. The renderer generates the screen of various layouts includingthe objects based on the attribute values calculated by the calculator.The screen generated by the renderer is displayed in a display region ofthe display 120.

The first to n-th interfaces 135-1 to 135-n are connected to the varietyof components described above. One of the interfaces may be a networkinterface connected to an external device via a network.

For example, the CPU 134 may copy an image analysis module stored in thestorage 150 to the RAM 131, and execute the image analysis module.Accordingly, the CPU 134 may analyze the image received from the imageproviding apparatus 200 to thereby obtain the apparatus information ofthe image providing apparatus 200.

Meanwhile, various exemplary embodiments described above may beimplemented in a recording medium that is readable by a computer or adevice similar to the computer using software, hardware, or acombination thereof. With a hardware implementation, the exemplaryembodiments described in the present disclosure may be implemented usingat least one of application specific integrated circuits (ASICs),digital signal processors (DSPs), digital signal processing devices(DSPDs), programmable logic devices (PLDs), field programmable gatearrays (FPGAs), processors, controllers, micro-controllers,microprocessors, and electrical units for performing other functions. Insome cases, the exemplary embodiments described in the presentspecification may be implemented by the processor 130 itself. With asoftware implementation, exemplary embodiments such as procedures andfunctions described in the present specification may be implemented byseparate software modules. Each of the software modules may perform oneor more functions and operations described in the present specification.

Meanwhile, the method for controlling a display apparatus according tovarious exemplary embodiments described above may be stored in anon-transitory readable medium. The non-transitory readable mediumdescribed above may be mounted in various apparatuses to be used.

The non-transitory computer readable medium does not mean a mediumstoring data for a short period such as a register, a cache, a memory,or the like, but means a machine-readable medium semi-permanentlystoring the data. Specifically, the programs for performing variousmethods described above may be provided to be stored in thenon-transitory computer readable medium such as a compact disc (CD), adigital versatile disc (DVD), a hard disk, a Blu-ray disc, a universalserial bus (USB), a memory card, a read-only memory (ROM), or the like.

Although the exemplary embodiments have been illustrated and describedhereinabove, the present disclosure is not limited to theabove-mentioned specific exemplary embodiments, but may be variouslymodified by those skilled in the art to which the present disclosurepertains without departing from the scope and spirit of the presentdisclosure as claimed in the accompanying claims. These modificationsshould also be understood to fall within the scope of the presentdisclosure.

What is claimed is:
 1. A display system comprising: a display apparatus configured to display a first image; an image providing apparatus configured to provide a second image based on receiving a control signal for controlling the image providing apparatus; a first remote control configured to transmit the control signal for controlling the image providing apparatus; and a second remote control, wherein the display apparatus is further configured to: receive the control signal for controlling the image providing apparatus, from the first remote control, and the second image, responsive to the control signal, from the image providing apparatus, display the received second image, identify a predetermined object in the second image by comparing the first image with the second image, obtain apparatus information of the image providing apparatus based on the control signal received from the first remote control and a change status of the identified predetermined object, and transmit the apparatus information to the second remote control, and wherein the apparatus information comprises a control code set corresponding to the image providing apparatus.
 2. A display apparatus comprising: a communicator; a display; and a processor configured to: control the display to display a first image received from an image providing apparatus, receive, through the communicator, a control signal for controlling the image providing apparatus from a first remote control, and a second image, responsive to the control signal, from the image providing apparatus, and control the display to display the second image, identify a predetermined object in the second image by comparing the first image with the second image, obtain apparatus information of the image providing apparatus based on the control signal received from the first remote control and a change status of the identified predetermined object, and control the communicator to transmit the apparatus information to a second remote control, wherein the apparatus information comprises a control code set corresponding to the image providing apparatus.
 3. The display apparatus as claimed in claim 2, wherein the processor is further configured to: compare the first image received by the communicator from the image providing apparatus before the communicator receives the control signal with the second image received by the communicator from the image providing apparatus after the communicator receives the control signal to identify a control command corresponding to the control signal, and obtain the apparatus information of the image providing apparatus based on the identified control command and the control signal.
 4. The display apparatus as claimed in claim 3, wherein the processor is further configured to control the communicator to transmit the identified control command and the control signal to a server, and receive the apparatus information of the image providing apparatus from the server.
 5. The display apparatus as claimed in claim 2, wherein the processor is further configured to obtain a logo in the second image provided by the image providing apparatus to obtain the apparatus information of the image providing apparatus.
 6. The display apparatus as claimed in claim 2, wherein the processor is further configured to, based on sensing a connection with the image providing apparatus and the communicator receiving the control signal for controlling the image providing apparatus, obtain the apparatus information of the image providing apparatus.
 7. The display apparatus as claimed in claim 2, wherein the processor is further configured to update a source name of the image providing apparatus based on the obtained apparatus information.
 8. The display apparatus as claimed in claim 7, wherein the processor is further configured to control the display to display a source list comprising the updated source name.
 9. A method for controlling a display apparatus, the method comprising: displaying a first image received from an image providing apparatus; receiving, by the display apparatus, a control signal for controlling the image providing apparatus, from a first remote control, and a second image, responsive to the control signal, from the image providing apparatus; displaying the received second image; identifying a predetermined object in the second image by comparing the first image with the second image; obtaining apparatus information of the image providing apparatus based on the control signal received from the first remote control and a change status of the identified predetermined object; and transmitting the apparatus information to a second remote control, wherein the apparatus information comprises a control code set corresponding to the image providing apparatus.
 10. The method as claimed in claim 9, wherein the obtaining the apparatus information of the image providing apparatus comprises: comparing the first image received before receiving the control signal with the second image received after receiving the control signal to identify a control command corresponding to the control signal, and obtaining the apparatus information of the image providing apparatus based on the identified control command and the control signal.
 11. The method as claimed in claim 10, wherein the obtaining the apparatus information of the image providing apparatus comprises: transmitting the identified control command and the control signal to a server, and receiving the apparatus information of the image providing apparatus from the server.
 12. The method as claimed in claim 9, wherein the obtaining the apparatus information of the image providing apparatus comprises obtaining a logo in the second image provided from the image providing apparatus to obtain the apparatus information of the image providing apparatus.
 13. The method as claimed in claim 9, wherein the obtaining the apparatus information of the image providing apparatus comprises, based on discovering a connection with the image providing apparatus and receiving the control signal for controlling the image providing apparatus, obtaining the apparatus information of the image providing apparatus.
 14. The method as claimed in claim 9, further comprising updating a source name of the image providing apparatus using the obtained apparatus information.
 15. The method as claimed in claim 14, further comprising displaying a source list comprising the updated source name. 